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ABSTRACT 


The purpose of this thesis is to investigate the use of the Headquarters 
Effectiveness Assessment Tool (HEAT) for a Command Post Exercise (CPX). Joint 
Chiefs of Staff (JCS) Exercise Powder River 1955 (PR85) at Headquarters Military 
Airlift Command (HQ MAC) was chosen for the evaluation. This thesis presents a 
description of the HEAT process, a description of HG. MAC's organization and 
interface with the Joint Deployment Agency (JDA), along with a historical 


accounting of the evaluation, its results, and recommendations. 
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I. INTRODUCTION 


One of the most acceptable means of determining the worth of a system, is by 
obtaining some sort of an effectiveness rating for that system. This process of 
determining an effectiveness rating has for a long time been applied to military 
weaponry. It has become almost routine practice to ask for the effectiveness of 


the weapon system prior to any purchase. This is most often stated in terms of 


Pk or probability of Kil. The successfullness of applying this measure towards 
the success of the weapon, led to the evaluation of other systems in the same 
manner. The result was an ever increasing need to have some sort otf an 
effectiveness rating for all types of systems. 

Applying some sort of an effectiveness rating to something as ill-detined as a 
Command and Control system, proved to be a challenge. Not only was there no 
real consensus as to what was a Command and Control system, but when a 
so-called system was to be evaluated there was no real feel as to what was a 
more effective system, either it worked and helped the organization or it hindered 
the organization. As it turned out most of the systems analysis comducted on 
Command and Control systems was based on the evaluator’s past experiences or 
Perception as to what a good Command and Control system should do and how 
well. There was rarely any set evaluation criteria to judge the effectiveness of 
the system. Thus, past studies barely accomplished more than identifying some 
problem area and recommending some solution that the evaluators thought would 
work. Almost never did the studies indicate what was effective or what standard 


was used in the evaluation. 


Ce 


A remedy to the subjective nature of Command and Control systems evaluations 
was needed. Νο longer could a Command and Control svstem compete for the 
scarce defense dollars without some legitimate measure of system effectiveness 
being applied. To this end, the Headquarters Effectiveness Assessment Tool was 
developed. Its purpose is to enable a team of internal or external observers to 
objectively assess and quantify headquarters performance and effectiveness. 

This thesis will document one such application of this Headquarters 
Effectiveness Assessment Tool (HE AT) as it was conducted during JCS exercise 
Powder River 85, HEAT was applied to the Military Airlift Command 
Headquarters as it was organized for this exercise and generally how it is 
organized for a contingency. This thesis will further describe the HEAT process, 
including the theory behind HEAT and a brief historical perspective on the HEAT 
development in Chapter II. A description of the organization evaluated by this 
tool, Headquarters Military Airlift Command (HG MAC), will be presented in 
Chapter III. This will include the organization of HG MAC during a contingency 
operation or exercise, its relationship and coordination with the JCS Crisis 
Action System and the Joint Deployment Agency, along with a detailed description 
of MAC’s Requirements and Flow Planning Cell, the center of activity for the 
scheduling of airlift requirements. Chapter IV will present a detailed chronclogy 
of the HEAT evaluation of HQ MAC from the first preliminary aspect through a 
growing awareness of the true organizational function of MAC and the evolution 
of the HEAT measures as this awareness unfolded. The results and corrective 
recommended actions will be presented in Chapter V with a brief section 


indicating areas for further studies. 


II. HEADQUARTERS EFFECTIVENESS ASSESSMENT TOOL (HEAT) 


A. HEAT HISTORICAL DE VELOPMENT 

The Headquarters Effectiveness Assessment Tool (HEAT) development project 
was a joint initiative by the Defense Communication Agency (DCA) and the 
Detense Nuclear Agency (DNA). Their issue concerned the survivability and 
effectiveness of Command, Control, Communications, and Intelligence (C3J) 
systems under the threat and during the course of a nuclear attack. Their main 
question was one of organizational size. How small could theater level 
headquarters be while still maintaining the ability to survive and be effective. 
However, before the question of size could be answered, the problem ot 
determining what is an effective headquarters had to be solved. DCA and DNA 
decided to first develop a method to differentiate between etfective and 
ineffective headquarters performance. This, then, would be followed by the 
identification of factors that helped to explain, predict, and eventually be used to 
control the level of effective performance. 

Defense Systems, Inc. (DSI) of Mclean, Virginia was awarded the developmental 
contract and was tasked with the accomplishment of these first two goals. Their 
product, HE AT, was developed to meet these goals by enabling a team of internal 
ог external observers to objectively assess and quantity headquarters 
pertormance and effectiveness, vielding reproducible effectiveness scores, It 
was these reproducible, quantitative, objective scores which would enable the 
evaluation ot a headquarters in different contigurations (mobile. distributed, 
unitary, underground, airborne, etc.) and at different times, lending insight into 


the performance of command centers at all levels. 
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B. HEAT THEORY 
HEAT, 4 an analysis tool, was developed to render quantitative, objective, 
and reproducible effectiveness scores in order to assist those charged with 
designing and running a higher level headquarters. The application of HEAT was 
for those headquarters that were primarily responsible for the planning, 
supporting and coordination of fighting forces, not direct war-fighting 
LRef.1:p.1-2]. Hence, it was this process of planning the mission, acquiring the 
resources, and directing the forces to accomplish the mission that was being 
evaluated. True effectiveness, then, was measured by the ability of the 
headquarters to develop and implement such plans while adjusting them for the 
information and assets available. 
Other Hey concepts of headquarters effectiveness identified during the 
development of HEAT were: CRef.2:p.i-5] 
* Effectiveness is the capacity to accomplish military missions. 
* Effectiveness of a theater-level headquarters is its capacity to operate as 
an adaptive control system such that it Keeps crucial factors in its environment 
(enemy actions, losses of territory, casualties, etc.) within expected 


boundaries. 


* The primary measure of effectiveness is the capacity of the headquarters to 
develop plans and use the resources available to bring those plans to truition. 


* When plans being used are not working, the effective headquarters is the one 
that can recognize that tact, develop alternative plans, and impiement them in a 
timely fashion. The effective use of contingent options is an important issue, 
because of the uncertainty inherent in military operations. 


+ Effectiveness is always measured in terms of interactions with the 
environment. 


* Timeliness, not speed, is essential for effectiveness. 


+ Speed and good quality decision making processes may бе necessary 
conditions for successful performance, but they are not sufficient for Success. 


1] 


Thus an effective headquarters is one that can survive, continue to perform its 
assigned mission, and make its presence felt in its environment. One that 
effectively produces desired military outcome while efficiently using its 
resources and time. The concept of mission accomplishment is ре Πιτ А 
headquarters can not be considered effective, no matter how well individual 
components accomplished their duties, if the mission failed. 

Recall, that the mission or objective of a headquarters (for a HEAT 
application) was that of planning for the war-fighting and not the war-fighting 
directly. As such, it would be inappropriate to use the result of combat as a 
measure of headquarters effectiveness. In fact, it could be argued that success 
in combat could occur even if the planning for a headquarters were ineffective. 
Thus, another conceptual approach or model to judge headquarters effectiveness 
had to be chosen. The approach taken during the HEAT development was that of 


an Adaptive Control System. 
C. THE ADAPTIVE CONTROL SYSTEM 


Under this concept the headquarters is seen as a system whose purpose is 
effectively dealing with an environment. This environment consists of everything 
outside the headquarters and includes: CRef.i:p.2-8] 


* own forces and the related resources 
* enemy forces 
* relevant friendly forces 

- superior headquarters 

- adjacent military organizations 

- supporting subordinate military organizations 
* operating environment 

- weather 

- terrain 

- political situation 

- economic situation 

- SOCial situation 


In order to control these dynamic and sometimes interactive features of the 
environment, a headquarters must proceed through a set of logical steps. These 
steps can be thought of as an adaptive control cycle for the headquarters or a 
headquarters cycle (see Figure 2-1). 

1. Monitor/Sense the Environment 

The control system must have a way to monitor those aspects of interest 
within its environment. It does this through the collection of raw data via its 
sensors. These sensors provide data on the aspects that the headquarters 
decides to monitor and hopes to control. The quality of this monitoring can be 
measured by comparing what the headquarters perceives to be true versus what is 
in fact "ground truth". Another indication of the quality of the monitoring 
process is the age of the data available. The quantity of old data indicates the 

quality of the monitoring process. 

2. Understand/Perceive the Situation 

Once the raw data is received by the headquarters, it must be processed into 
some usable form. This processed information is then used by the decision 
makers to interpret or understand the environment. This processed information, 
however, is almost never complete and up-to-date. Time delays occur through the 
orocessing of the raw data and through the communications delay from the 
sensors to the headquarters. Similarly, a sensor's information may be absent or 
misleading, instiling even more uncertainty into the evaluation. Thus, a 
headquarters can never be absolutely certain as to what is going on, but must use 
all available information to hypothesize about the current situation. This 
hvpothesis of the situation can be correct, adequate for the mission, or incorrect. 


It is this quality of understanding the situation that HEAT measures. 
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3. Develop Alternative Actions 
The headquarter's next step, after an understanding of the situation is 
reached, is to compile a list of alternative sets of actions. The emphasis at this 
point is not on a quality alternative but in surfacing a variety of different 
alternatives to evaluate. Experience with decision-making has made it clear that 
better decision processes are characterized by consideration of a number of 
alternatives and by the variety of alternatives considered. These are not 
measures of the effectiveness of the alternatives formulated but measures ot the 
quality of the process used to develop them. 
4. Predict Results of the Alternative Actions 
For each alternative action deemed viable, the headquarters must predict or 
speculate on the results of that particular action. This must include at least two 
elements: LRef.3:p.3-13] 
a. do the force and material assets exist, or can they be assembled to carry 
out the alternative? 
b. what will the enemy’s response Бе? 
This process of predicting the comsequences of an alternative can be 
evaluated bv determining: LRef.1:p.2-15] 
* their completeness: better prediction sets deal with questions of asset 
availability and enemy reaction across the full range of hypothesized 
Situations tor each alternative. 
* the correctness of those predictions actually adopted. This is measured on 


the same scale as the hypothesized understandings ~~~ correct, mot incorrect, 
and incorrect. 


3. Compare Prediction with Desired State 
This step in the headquarters cycle is implied by the model used by HEAT 


but is better defined in J.S. Lawson's C3 model (see Figure 2-2). During this step 
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Figure 2-2  Lawson's C3 Model 
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the predicted results are compared against a desired outcome. Those 
alternatives that help achieve the desired result are considered for possible 
execution. Those alternatives which do not meet or assist in obtaining the final 
desired state are discarded and not continued in the decision cycle. Thus, this 
step is an aid to the decision maker, reducing the set of possible alternative 
actions. 
6. Decide 
Probably the least understood of the headquarters cycle steps, this is where 
the actual decision takes place to select a given course of action, to develop a 
plan of action. Of all the alternatives remaining, the "best alternative" is chosen 
by the decision makers. This process is contingent on the particular headquarters 
and on the decision makers themselves. Due to the complexity of the actual 
decision process, there are no direct measures on the quality of the decision. 
Rather, the quality of the decision made is reflected in the overall effectiveness 
of the headquarters. However, measurable, tangible entities result from this 
step and the development of a plan that includes the mission objective, the 
assets required, and the time-frame to accomplish the mission. 
7. Direct 
The resultant plan is communicated tothe subordinate commanders. The 

directions given in the plan can be evaluated as to the extent that the 
headquarters correctly stated the environment and the required mission. An 
ordinal value of "correct" or "incorrect" can be assigned by comparing the 
tollowing components with their respective "ground truth": 

a. the mission statement 

b. the operational boundary or environment 

c. the assigned assets 

d. the time-frame to accomplish the mission 
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D. HEAT MEASURES 

If HEAT was applied in its entirety, across the full spectrum of the 
headquarters, in all of its roles and functions, then the HEAT application would 
yield six overall measures and 135 diagnostic measures of process ог 
effectiveness. Of these 141 individual measures only two can be considered true 
measures of effectiveness. [Ref.1:p.3-2] 

{. Percentage of intended period that plan is not in force. 

2. Percentage of control cycles for which the control mechanism is: excellent, 
adequate, or inadequate. 

The 135 diagnostic measures are separable into the six headquarters process 
steps of the HEAT headquarters cycle (reminder, HEAT did mot comsider the 
compare function as a separate step). These measures are, also, separable into 
six data categories synonymous to the major functional components of a 
headquarters plan (see Figure 2-3). 

Applying all of these measures in a single evaluation would be an immense 
task, involving large amounts of data and data-gatherers. As such, the normal 
HEAT application focuses оп scoping the 141 measures down to a reasonable and 
doable number LRef.1:p.3-1J. This reduction in the number of measures iri 
contingent on the application and the headquarters involved but more specifically 
on what measures the application will support based on the headquarters 


Command and Control system being used. 


E. HEAT PROCESS 
Implementation of the HEAT process is far from automatic LRef.4:p.5J. The 


first, and most important, task is of defining the application and the 
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headquarters involved. This must be accomplished prior to beginning any of the 
steps in the HEAT application and is critical for the success of the HEAT 
evaluation, Without the most through understanding of the headquarters and the 
interrelationship of the headquarters internal structure (in regards to the 
particular application), one can not hope to capture the true effectiveness of that 
organization. 

This is where the user or headquarters must take an active part in the 
evaluation. The headquarters will provide insight as to which areas ot the 
headquarters process it wants evaluated, indicate where in the internal 
organization those processes occur, and provide the observers with the access 
required to obtain any necessary data. In other words, the user or headquarters 
must have a thorough understanding of the HEAT process, just as the observers 
must have a thorough understanding of the headquarters. 

1. Defining the Problem 

The first step in the HEAT process, and the most important, is to define the 
purpose of the study and to determine the focus of the application. If sufficient 
time and effort was spent with the preparation work (as detailed in the previous 
paragraphs), the first portion is almost complete. There may need to be some 
refinement in the actual wording of the purpose to more closely align it with that 
of HEAT but it should be relatively straight forward. These will enable 
concentration into the more difficult portion of determining the focus of the 
evaluation. 

Focusing the application will determine the overall level of effort required 
and the Kind of trade-offs that need to be made against the resource constraints. 


It will lead to the "first cut" of HEAT measures to be applied. This first-cut will 


be based primarily on the purpose of the application and will lead into the second 
step of the HEAT process, scoping the problem. 
2. Scoping the Problem 
During this phase, the task is cut down to a manageable size that is still 
broad enough to provide some response to the purpose of the study. Here, the 
user (headquarters) will formally look into the organization, its functions of 
interest, and the functions that can be assessed with the available resources. 
This process consists of four steps: LRef.1:p.4-3J 
* characterize the organization to be studied 
* identity functions for study 
* map the organization onto the functions 
* train the observers 
a. Understand the Organization 
This step starts with the internal relations identified by the head- 
quarters during the preliminary planning. The internal structure as presented by 
the organization is verified but more importantly any changes to the structure 1s 
annotated. Additionally, the so-called К таай organization (the way the 
organization really works) is documented. Both of these must be captured for the 
HEAT application to be successful. 
b. Identify Functions for Study 
This process involves a collection anda refinement of the primary 
objectives identified during the problem definition phase. Here, the specific 
exercise or evaluation objectives are identified (see Figure 2-4). 
c. Map the Organization onto the Identified Functions 
The purpose of this approach is to outline to the observation team now 


many events are likely to involve each of the staff directorates (of the tormal 
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structure). This mapping (an example presented in Figure 2-5) will be useful in 
determining the amount of observers required to collect the data and help to 
scope down the HEAT measures to be evaluated. 

The last portion of this step, is the identification of the events which 
will support the various objectives. This will be useful in determining if the 
event provides enough data to be observed and in scheduling the limited 
resources available. 

d. Training 

Training is essential if the application is to be successful. Individual 
observers should be familiar with both the organization under study and the 
concepts and application of HEAT. In addition, the observers should be familiar 
with the concept of a control cycle and its application to that of the headquarters 
cycle, With these understandings, it is much more likely that the observers wili 
observe and record significant data. 

In summary, a series of matrices (Figure 2-5) and time lines (Figure 2-5) 
should have been prepared to assist in the determination of what is doable given 
the limited resources. When concluded, the observer team should understand: 
CRef.1:p.4-9 ] 

* what the problem is 
* what the organization of the HG. being studied looks like 
* what functions of the organization are to be tested 
* where and when the actions will take place 
* how many observers will be necessary to do the job 
3. Plan the Approach 
This phase is concerned with the details of the application. This includes 


the placement of the observers, the identification of the MOE's, deciding on an 
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approach to be taken, developing command standards, and developing a collection 
plan. 
a. Placing Observers 
Placement of the observers is a crucial step in obtaining useable data. 
The organization/function matrix will be of assistance during this step. There 
may be physical limitations imposed by the organization being evaluated, but if at 
all possible, have observation teams of two people for each of the organizational 
cells being studied. In addition, one or more roving observers will be required 
depending on the size and geography of the organization. These roving observers 
will assist the individual observation teams by transferring information between 
the respective teams. In addition, this observer would gather more a subjective 
impression of the overall organization. 
b. Selection of HEAT Measures 
Now that one has an understanding of how the Headquarters 1s organized, 
how it accomplishes its mission, what functions within the organization are going 
to be observed, and what the evaluation objectives are, one can now identify the 
specific HEAT measures to be evaluated. Since the HEAT measures are specific 
for a given Headquarters process and function, it is a simple matter to select 
appropriate measures once the function to be observed is identified. The specific 
measure can be isolated/narrowed even further by identifying the required data 
and verifying that that data can be collected. 
c. Decide on a Approach 
This step is concerned with what type of data to collect and how that data 
is to be collected. It also takes care of some of the logistics needs of the 
observation teams, such as: lodging, subsistence, access to operational areas, 


travel, and distribution of collected data. Data can be collected in many ways: 


collect everything, collect in random cycles, or collect in prearranged cycles. 


Regardless, the sources of data must be identified. Some examples of possible 


sources are: 

* briefing charts 

* messages 

* status reports and briefings 

maps and photographs 

* telephone and radio logs or conversations 

* computer printouts 

* letters and memos 

d. Command Standards 
While this step is necessary for the scoring of the collected data, it in 
itself is mot necessary for the actual collection. However, having command 
standards (Figure 2-7) at the beginning will help identity to the observers what 
1s acceptable limits for a given process. Regardless, to be truly acceptable, 
these standards should at the very least be concurred to by the Headquarters 1+ 
not jointly developed. 
e. Develop a Collection Flan 
The Collection Plan (Figure 2-52) is where all the previous eftorts are 

documented. This is not a static document and it may {and probably should: 
undergo many revisions before a final collection of the data is per*crmed. The 
collection plan will function as a ledger of all past activities and the reasons for 
them. If Kept current, it will prove to be quite useful in documenting any changes 
in the final report. (This report format and premises of a current Collection Plan 


is the basis for Chapter IV). 
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Problem Statement 


® Objective or Objectives 


Background 


2.1 Headquarters to be Studied 


° Organization 
+ Formai 
+ Informal 
e ВЕБ < 
5 CJ System Organization 


Functions of Interest 


212 Exercise 


Details (Dates, Location, Participants) 
Objectives 

Objectives of Interest 

Events of Interest from © or | ss. 
Points of Interest from Exercise Plan 


2223 Resources 


а No. of Observers Available 
° Background of Observers 
ә Objectives and Events to be Worked 
© Travel Money Necessary 
© Locations to be Visited 
Approach 


з] Collection 


° Sources of Data 
+ Manuals, Messages, Exercise Plan, 
Directives, Interviews, Historical Dates 
Interviews 


+ List of all Possible and Most Probable 
+ Objectives and Events to be Worked 

e Quality and Detail of Data (All Data, Random 
Data, Planned Sequences of Data) 

° Procedures to Set Up Automatic Distribution 


(Messages, Briefing Slides, Telephone 
Summaries, etc.) 


Figure 2-8 HEAT Collection Plan Format 
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5.0 


4.22 еа 


Organization 

$ Organization of Teams 

i NO. in a Team 

+ TEEN KEDOETING Structure 
+ Responsibilities 


Objectives and Events to be Worked by 
Observers | 
Assianments 


ЗЭЭ Command Standards 


Identify What Types Needed 

т MOE's, Data Sheets, Sources 

Develop Eerly Straw Men, Iterate Approvals 
with User's 


Organization 

+ List All Details 

Ш Arrange in Sequence for Accomplishments 
+ Assign Times 


Sugaested Topics 

Arrange Pre-Details, Deploy Advance Tean, 
νυ Ἠ5-ετνετο, COLlE® Veca, Arrange for 
Return to Base, Reduce Data Perform Analysis, 
Write-Up 

Construct Task-Timing Chart 


Oustandina Problems 


Suggested Proplem Areas: 

(Clearances, Travel, Local Travel, Food and 

ο οσο Courier Letters, Classified Storage, 
Badges, Who to Contact if Problems Occur) 
Construct a Log Book Early and Keep it 
Current 


+ All Decisions 

+ All Key Events 

+ All Problems--List What, Who, and How 
Solved 


Figure 2-8 HEAT Collection Plan Format 


31 


4. Data Collection 
Upon reaching this stage of the HEAT process, most of the group's time and 

work has been completed, for the rest is almost mechanical in nature. There is 
however, one more important step that could save time and avoid complications, 
deploy an advance party. This advance party will take care of all the logistic and 
administrative items that were missed. Items that their checklist should include 
are: 

* clearances, lodging, and local transportation for all observers 

* arranging for the automatic collection of certain data 


- messages, incoming and outgoing 


briefing slides, notes, minutes 


telephone and radio logs 


internal memos and letters 
- data automation products 
5. Analysis and Write-up 

With the multitude of data collected, it is now time to do some thing with it. 
One of the most useful tools in organizing the data for analysis is a time-line 
(refer to Figure 2-6). This time-line may be a simple listing of the chronological 
events or a more complicated time diagram illustrating intervals between events 
as well. Depending on the complexity of the evaluation, it may be desirable to 
have multiple time-lines, one for each function observed or one for each 
headquarters cell observed. Regardless of how detailed, a time-line will ease 

the data reduction and analysis. 
HEAT also offers two other aids to data analysis. After the data is 
collected it is entered onto data sheets (Figures 2-9 and 2-10). These sheets 


identify what specific information is needed for each of the functions or 
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measures of interest. This process helps to reduce data from a variety of 
sources to only a few separate data sheets (a few hundred at times) referencing 
the original document. The next reduction of data is accomplished thru the 
process of transcribing certain information from the data sheets to the HEAT 
score sheets (Figures 2-11 and 2-12). These data sheets and score sheets are 
cross matched with each score sheet identifying which data sheets are needed to 
complete it and vice versa. The only additional input needed for the score sheets 
is the command standards. These standards, as mentioned earlier (Figure 2-7), 
are needed to score what the organization views as acceptable limits or variation. 

Once all the analysis is conducted, the final report can be assembled. This 
report, format presented in Figure 2-13, should include a brief description of 
HEAT, a description of the organization studied, a chronology of exercise events, 


and the data analysis along with the conclusions and recommendations. 
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SCORING SHEETS 


Alternative Actions Scoring (Code A) 
Decision (Direction) Scoring (Code D) 

Enemy Location Scoring (Code L) 

Enemy Monitor/Report Scoring (Code M) 

Enemy Unit Timeliness Scoring (Code E) 
Environment Report Scoring (Code V) 

External Conditions Scoring (Code K) 

Guidance Message Scoring (Code G) 
Headquarters Cycle Scoring (Code H) 
Information Report Scoring (Code I) 

Own Timeliness Scoring (Code F) 

Own Unit Accuracy Scoring (Code O) 

Plan Quality Scoring (Code Q) 

Prediction Scoring (Code P) 

Report (Prediction) Scoring сасе) 

Report (Understanding) Scoring (Code R) 
Special Weapons (Category) Scoring (Code C) 
Special Weapons (Perception Scoring) (Code W) 
Understanding (Enemy) Scoring (Code X) 
Understanding (Implementation) Scoring (Code U) 


Understanding (Operability) Scoring (Code S) 


Figure 2-11 HEAT Score Sheets 
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INTRODUCTION 


Problem to be studied 
Purpose of the exercise 


Overview of the analysis 


HEAT OVERVIEW 


DESCRIPTION OF THE XYZ ΠΕΛΡΟΡΔΑΤΕ FRUOCESS CONCERTS 
THE EXERCTSE PURPOSE 


XYZ Headquarters Command Relationships to Superior 
and Component Organizations 


+ Formal 

+ Informal 

XYZ Headquarters Organization 
+ Formal 

+ Informal 


process Information Flow 


+ in terms of the generic headquarters process 
(brief) 
+ in actuality (as much detail as necessary to 


serve purpose of analysis document) 


NARRATIVE AND CHRONOLOGY 


* Time-line of events 

* Narrative focusing on patterns of stimulus- 
decision-response-outcome 

ANALYSIS 

e XYZ Headquarters Processes and Effectiveness 


+ MOM Goring 

= Data Base Accuracy 

= Data Base Timeliness 

- Queries for/on reports 
+ Understanding 


+ Planning 


- Developing Alternatives 
= Developing Predictions 


Figure 2-13 HEAT Report Format 
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+ Direct (Coordinate) 
= Compliance of coordination actions with 
higher guidance 
- Timeliness of coordination actions 
T Query-Response 
- Queries on XYZ Headquarters messadaes 
_ XYZ Headquarters responsiveness to 


queries for information 


a XYZ Headquarters opportunities vis-a-vis original 
problem statement 


CONCLUSIONS AND RECOMMENDATIONS 


P'aqure 2-13 HEAT Report Format (continued) 
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III. HEADQUARTERS MILITARY AIRLIFT COMMAND (HG MAC) 





A. INTRODUCTION 

How does the Military Airlitt Command accomplish its mission? For that 
matter how does it receive its mission requirements, especially for any given 
contingency. These questions will be addressed in the next few pages. 

The Military Airlift Command’s mission is varied and complex. As a Specified 
Command, it is responsible for the air transportation of both cargo and troops. 
This includes both long haul/trans-oceanic movement and also, intra-theater 
movements. As described in Air Force Regulation 23-17 its mission is one ot 
support to the Theater Commanders. 

"The overall mission of MAC is to maintain, in a constant state of readiness, 

the militarv airlift system and other svstems and services to perform all tasks 

assigned by the Joint Chiefs of Staff (JCS) and appropriate JCS and Air Force 
guidance documents." LRef. 5:p.1-33 

However, it has a dual role. MAC must not only transport the needs (people, 
equipment, etc.) of the theater commanders, but also, their own requirements. 
Many times MAC must transport additional support equipment so that it can 
accomplish its primary goal of support to the theater commanders. It must ensure 
that all the necessary ground equipment is at the receiving air field to enable 
their self to accomplish their mission. As such, MAC has the dual role of being a 
supporting CINC and a supported CINC. This complexity of a dual role plays an 
important part in MAC: s interface with the Joint Deployment Agency (JDA) and 


the Joint Deployment System (JDS). 
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B. THE JOINT DEPLOYMENT SYSTEM 

The Joint Deployment System (Figure 3-1) was developed to more efficiently 
handle the immense task of support to theater commanders especially during 
times of crisis. At the core of the JDS is the planning cycle which refines the 
operational plan (OPLAN) and produces Timed-Phased Force Deployment Data 
(TPF DD) for the OPLAN. This TPF DD sets the initial data base as to which units 
are to be emploved, which units require deployment, along with an estimate of the 
transportation requirements and a priority code to indicate the order or sequence 
of their movement. A brief look at this planning cycle is in order before 
preceding to look at the actions taken during a contingency situation. 

The planning cycle begins when the supported commander produces a plan 
concept. This plan concept is in turn used to initiate a basic TPFDD for 
submission to JDA for review and refinement. The submitted TPFDD will include 
as much of the following information as possible. CRef.6:p.4-2] 

- types of forces required 

- type of unit, movement data (TUCHA) sis 

- providing organization 

- proposed routing 

- proposed origin 

- proposed ready to load date at origin 

- earliest and latest arrival dates at port of debarkation 
- desired port of debarkation 

- required delivery date at debarkation 

The review process is accomplished in two phases. Phase i validates ano 
completes the supported commander's TPFDD to permit more accurate evaluation 
of transportation requirements and the scheduling of movements LRef.$:p.4-3]. 
This is accomplished by identifying the actual force units to meet force 


requirements, any non-unit personnel or augmentation requirements, and the 


actual movement characteristics (as listed above) of these requirements. The 
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supported commander and the supporting commander resolve any variations or 
changes and identify any shortfalls in meeting the requirements. All of the 
following actions are taken during the Phase 1 validation. CRef.6:p.4-6] 
- refinement and completion of the TPF DD 
- designation and validation of specific forces 
- identifies force shortfalls, coordinates resolution if possible 
- determine capability to fill non-unit personnel or augmentation requirements 
- identifies non-unit personnel shortfalls 
- establishes dates for the supporting commands to finalize movement tables 
and sets a date for the next review, Phase 2. 

Phase 2 verifies that the transportation requirements are within the 
capabilities of the Joint Services. All transportation difficulties are resolved 
and any shortfalls in force structure are accounted. Upon resolution of all 
shortfalls the TPFDD is finally ready to be included in the OPLAN and loaded as 
the JDS data base for that OPLAN. This data base is the basis of all 
transportation requirements if this OPLAN is exercised. 

The JDS data base can be quite useful during a crisis situation. As it contains 
a basis to begin planning, it is used throughout the Crisis Action System (CAS) 
planning cycle. This cycle is divided into six phases LRef.ó:p.ó-1 ]. 
(1) Phase 1 - Situation Development. 
(2) Phase 2 - Crisis Assessment. 
(3) Phase 3 - Course of Action Development. 
(4) Phase 4 - Decision. 
(5) Phase 5 - Execution Planning. 
(6) Phase 6 - Execution 
The JDS data base plays only à minor role in the first two phases of the CAS 
cycle. Phase 1 is the identification of a possible crisis situation and the 
reviewing of available plans or options. Here, the JDS data base is used for 


problem analysis and to determine if there exists an OPLAN and TPFDD for the 


possible crisis. During Phase 2, a crisis is actually declared. In this phase the 
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JDS data base continues as a problem analysis tool but, more emphasis is placed 
on the impact of execution of the OPLAN(s). 

Phase 3 is the first operational use of the JDS data base. Upon issuance of 
the Warning Order (issued at the end of Phase 2), the Joint Deployment Agency 
starts preparing a deployment estimate to include a tentative C-day and L-hour. 
This can be accomplished in three ways. First, if an existing OPLAN covers the 
situation JDA will load its associated TPFDD for immediate update and 
refinement. Second, if the appropriate OPLAN requires modification, the JDS 
data base has been modularized to ease any modification. The last and most time 
consuming case is if no OPLAN exists. Here, the procedures identified in the JDS 
planning cycle (OPLAN and TPFDD refinement) need to be accomplished. Once the 
initial requirements are identified by the supported commander, they are entered 
into the data base for refinement under this phase. The validation (the review 
process mentioned in preceding paragraphs) is not conducted per se but, at the 
expense of probably more transportation shortfalls. These shortfalls are a 
direct result of not enough time to enable the more thorough review afforded 
when a plan 1s not prepare in a crisis situation. 

Again, during Phase 4 the JDS data base is not used extensively. After the 
update to the data base is accomplished in Phase 3, JDA provides this 
information in a capsulized form, along with a tentative C-day/L-hour to the JCS. 
The JCS will then issue an Alert Order which will initiate Phase 5. 

The Execution Planning, Phase 5, begins upon receipt of the proposed 
C-day/L-hour in the Alert Order. JDA will immediately coordinate with the 
supported and supporting commanders and recommend a firm C-day/L-hour. At 
the same time, JDA will accomplish and coordinate any last minute updates to the 


data base, focusing on the first six days of air movement and the first 30 days 
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for surface movements, based on earliest arrival date (EAD). JDA will continue 
to update the data base in one-day increments for those C*5 and C*29 day air and 
surface requirements. 

Extensive participation by the supporting commanders is required during this 
phase. The procedures that the Military Airlift Command (MAC) follows will be 
discussed in detail. However, keep in mind that similar actions are taken by the 
Military Traffic Management Command and the Military Sealift Command for 
surface movements. 

Upon notice from JDA that the first six days of the data base is ready, MAC 
will pull or extract the first five days of air movement requirements, based on 
latest arrival date (LAD). (Reminder; JDA accomplishes their update by EAD, this 
could possibly cause some conflict). These requirements are grouped by 
ONLOAD/OFFLOAD channels (scheduled air routes) MAC will then develop 
schedules to meet the requirements over these onload-to-offload channels. MAC 
will, as soon as possible, send the first two days of schedule back to the JDS. 
This will be followed by the remaining three days. This will enable JDS to assign 
specific units of payload, by the requirement’s priority of movement, to the 
scheduled carrier. This process will repeat itself in 1-day increments upon 
notification from JDA that the next days movements are available for scheduling. 

The last phase, Phase ó - Execution, is initiated when the Execute or 
Deplovment Order is issued. Once again the JDS data base has a limited role. 
The actual Execution Phase is the direction and monitoring of previously planned 
movements. Thus, there is a constant transition between these last two phases. 
While one day's movements are being executed, one-plus-five dav's requirements 


are being scheduled. In fact, in a changing situation where the original OPLAN is 
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no longer valid, returning to Phase 3 and the current day’s movements may be 
required. 

As described, one can see the benefits of this system as a management aid, 
especially during times of conflict. Briefly, the JDS is a data base to help the 
supported commanders identify their requirements for a given OPLAN. To obtain 
this data base, the supported commander must develop Time Phased Force 
Deployment Data or TPFDD. This TPFDD goes through a review process to 
decrease the possibility of transportation shortfalls (this usually means a 
decrease in requirements at this stage), and once finalized is the basis of support 
for that OPLAN. When a crisis develops, planning is expedited if an OPLAN and 
TPFDD exist. Regardless, crisis planning is accomplished in the six phases of 
the Crisis Action System (CAS). Throughout, CAS planning relies heavily on the 
JDS data base (as always the data base is only as good as its last update, it 
therefore relies heavily on the CINC's for update). Even during times of 
transition between OPLANs, the JDS data base can be used to more efficiently 


and quickly identify new requirements and schedule their movements. 
C. THE MILITARY AIRLIFT COMMAND 


The previous section described how MAC received its movement requirements 
and very briefly how MAC interfaced with the Joint Deployment System (JDS). 
Now, we will take a more in depth look at how MAC schedules aircraft to meet 
these requirements and how MAC responds to a crisis situation. 

MAC is an active participant in the JCS Crisis Action System (CAS). In 
response to a more formalized procedure to support the CAS, MAC formed the 


Headquarters MAC Crisis Action Team (CAT). This CAT provides for the 
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interface between JCS requirements and the scheduling of those requirements. 


As such, the CAT is the MAC focal point during a crisis. 

The Headquarters MAC Crisis Action Team (CAT) provides CINCHAC 
expedited staff action and a single focal point within the MAC staff for the 
execution management of MAC forces during time-sensitive Operations. 
Additionally, the Headquarters MAC CAT serves as a single staff activity for 
providing required critical information to the JCS, other tasking agencies, and 
subordinate MAC organizations. 

The Headquarters MAC CAT acts as CINCMAC’s executive agent. 
Instructions issued by the MAC CAT through the MAC CAT Director are 
directive upon the MAC staff and all MAC forces. CRef.7:p.1-13 

The MAC CAT (Figure 3-2) is organized in a layered approach with only the 
Prime CAT being immediately notified in a crisis situation. The senior airlift 
controller will then recommend to the CAT Director the addition or deletion of 
CAT members based on the nature of the crisis CRef.?:p.c-2]. These additional 
personnel may include the Special CAT, task-oriented support ceils, or any other 
designated individuals. The Prime CAT will be the principal agency through which 
command guidance is passed for implementation CRef.?7:p.3-11J. For closely held 
operations, the Prime CAT mav be the sole members responsible for deveioping 
M AC's course of action. Composition of the MAC CAT is diagramed in Table 3-1. 

1. The Prime Crisis Action Team 

The Prime CAT will tocus on airlift concept development, coordination with 
JCS. Services and supported commands, as well as monitoring the execution of 
airlift operations. The Prime CAT will be the principal agency through which 
command guidance is passed tor implementation. LRef.7:p.3-1)J 
a. The CAT Director 
The CATD acts as CINCMAC’s executive agent. All CAT messages are 


released under his authority. His responsibilities are: CRef.7:p.4-3] 


(1) Ensure the proper response to emergency requirements 
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TABLE 3-1: H@ MAC CAT MANNING/SGURCING 


Prime CAT: 
Director ‘CATD) Operations (CATO)? 
Executive Officer (CATE) Operations Plans САТХ) 
Executive Support NCO CATH) Transportation ‘CATT? 


Logistics ‘CATL) 


Special CAT: 


Intelligence Communications 
Security Police Surgeon 

Lomptroller Public Aftairs 
Engineering and Services Weather 

Chaplain Personnel 

Assistant tor Civil Air AF OSI 
administration Data Automation 
special Operations Staff Judge Advocate 
Üperations Command and Contro! 
Transportation Logistics 
Üperations Plans Liaison Groups 


(Army ,Navy ,Marine,TAC, SOC, ESL, 
AFRES,and ANG as required) 


Task-Oriented Cells: 


Support Cell Responsible to Special CAT 
Requirements and Fiow Planning Operations Rep 
Manpower/Personne! Readiness Personnel Rep 
Mission Support and Augmentation Operations Plans Rep 
Station Data Logistics Rep 
Port Management Transportation Rep 
Connectivity Command and Control Rep 
Reports and Brieting Command and Control Кер 
Classi¢ted Automated System (WIND Command and Control Rep 
Administrative Support "Prime CAT Exec «САТЕ " 
CRAF Representatives Assistant for Civil Air 


(2 Ensure tasks assigned to MAC are accomplished 
(3) Ensure CINCMAC and staff are informed of all critical information 
impacting the Command 
(4) Serve as the primary point of contact for JCS, Air Force, supported CINC, 
and MAC numbered Air Force Battle Staff/CAT directors. 
b. The CAT Executive Officer 
The CATE serves as the executive officer and the administrative officer 
for the CATD. As such his duties include the screening of incoming/outgoing 
messages, maintaining the CAT message file, and provide administrative support 
as required. 
c. The CAT Executive Support NCO 
The CATN is the chief administrative clerk for the MAC CAT. He ensures 
that all needed administrative support is available. 
d. The CAT Operations Officer 
The CATO assists the CATD in developing MAC courses of action. He 
serves as primary contact and director of all MAC Air Force operations. He is 
responsible for directing and supervising the activities of the Special CAT 
Operations and Command and Control representatives to include determination of 
airlift requirements, flow planning, airlift taskings, emergency action procedures, 
communications connectivity requirements, and reports and briefings. He is also 
responsible for consolidating the daily situation report (SITREP). CRef.7:p.6-2] 
e. The CAT Operations Plans Officer 
The CATX is responsible for accomplishing the required emergency action 
procedures. In addition, he provides the required information applicable to 


existing support plans. 
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f. The CAT Transportation Officer 
The CATT is responsible for Airlift Concept Development in relation to 
the aerial port. He monitors aerial port manpower and equipment resources and 
directs relocation of assets as appropriate. 
g. The CAT Logistics Officer 
The CATL is responsible for the maintenance and supply support for the 
airframes and aerial ports. 
2. The Special Crisis Action Team 
The Special CAT encompasses most functional areas within the head- 
Quarters. Special CAT members serve as the direct liaison between the Frime 
CAT and their assigned functional areas. It should be emphasized that Special 
CAT members do not work in isolation. They are expected to call om members of 
their functional area staffs to assist them as required. LRef.7:p.3-2] 
3. The CAT Support Celis 
Task-Oriented Support Cells (Figure 3-3) combines expertise from across 
the MAC staff into specific task-oriented teams. Cell composition should be 
reviewed frequently by cell team chiefs to ensure the most effective and efficient 
manning is assigned to conduct the detailed staff work required. LEef.7:p.3-2J 
a. The Requirements and Flow Planning Cell 
This cell analyzes movement requirements and the airlift capability to 
meet the requirements. They are responsible to prepare a flow plan (airlift 


schedule). 
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b. The Manpower/Personnel Readiness Cell 
This Support Cell is responsible for personnel tracking. In conjunction 
with Air Force Personnel Readiness Center ensures the augmentation of forces 
when required. 
c. The Mission Support and Augmentation Cell 
This cell is responsible for personnel tracking and tasking with the MAC 
forces. When mobilization is required, they must furnish the manpower and 
personnel readiness cell with validated requirements. 
d. The Station Data Cell 
The Station Data Cell has responsibility for the tracking of airfield 
suitability. 
e. The Port Management Cell 
This Support Cell monitors the passenger and cargo workloads at the 
airfields. 
fF. The Connectivity Cell 
This cell insures real-time interoperability between the intelligence, 
operations, communications, and command and control functional areas. 
g. The Reports and Briefing Cell 
This Support Cell reviews all reports and briefings prior to the CATD 
approval and release. 
h. The Classified Automated System (WIN) Cell 
Tne WIN Cell operates and ensures continuous connectivity over the 
WWMCCS Interface Network (WIN). 
i. The Administrative Support Cell 
The Administrative Support Cell is responsible to the CATE and CATN to 


provide required administrative support. 
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je The CRAF Representative Cell 
This Support Cell provides information and advice on the Civil Reserve 
Air Fleet. 

While each CAT member or task cell accomplishes a vital function, it is 
primarily the Operations and Command and Control representatives to the Prime 
and Special CAT that interfaces most with the Joint Deployment System (JDS) and 
the MAC forces. As such, the CATO is the focal point of all actions effecting the 
scheduling or movement of MAC forces. He has direct responsibility for the 
Special CAT Operations and Command and Control sections. As mentioned 
previously his responsibilities bear repeating. 

The CATO will assist the CATD in developing MAC courses of action during 
concept development, and make necessary revisions during execution. The 
CATO will serve as the CATD’s primary contact with, and director of, all MAC 
Air Force operations. The CATO is responsible for directing and supervising 
the activities of the Special CAT Operations and Command and Control 
representatives to include determination of airlift requirements, flow planning, 
airlift taskings, emergency action procedures, communications connectivity 
requirements, and reports and briefings. The CATO is responsible for 
consolidating the daily situation report (SITREP). CRef.7:p.6-2] 

The CATO further divides his multitude of responsibilities between the Special 
CAT Operations and Special CAT Command and Control. The Special CAT 
Operations representative is mostly concerned with the ooerations of the MAC 
forces. His activities include airlift requirements, flow planning, airlift 
taskings, and emergency action procedures. Of primary concern are the first two, 
airlift requirements and flow planning accomplished by the Requirements and 
Flow Planning Cell. The Special CAT Command and Control representative is 
concerned with the communication of information from the requirements to the 
torces and the reporting of the forces current status. Of most importance is the 


interface with the JDS accomplished by the Classified Automated Systems (WIN) 


Cell. We will take a closer look as to how these two cells accomplish their duties. 
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The Classified Automated System (WIN) Cell, consisting of up to nine NCO's 
(depending on the severity of the contingency and on WIN traffic load), has a very 
simple yet, important task; to maintain communications over the WWMCCS 
Interface Network (WIND. This network is used to communicate or access the JDS 
data base and secondly, for other message traffic to and from supported 
commanders or MAC forces. As such, it is the prime communications media by 
which MAC receives its requirements and informs others of its scheduled airlifts. 
This system or cell supports all the CAT members but in particular the 
Requirements and Flow Planning Cell. 

The Requirements and Flow Planning Cell, consisting of between four and six 
officers, is the one entity which is directly evolved in all phases of the 
operational mission planning. Upon receipt of the requirements from either the 
JDS or some other means, this cell must develop a schedule of MAC airflights to 
fulfill the requirements. In this aspect, they are the direct users of the JDS data 
base and their scheduling product is the required input into the Joint Deployment 
System. The Requirements and Flow Planning Cell responsibilities include but 
are not limited to the following CRef.7:p.6-3 1: 

(a) Determining and analyzing movement requirements and current airlift 
Capability to meet those requirements based on guidance from the Special CAT 
Operations representative. 

(>) Preparing manual flow plans to support crisis/contingency requirements. 

(cj) Preparing applicable portions of the CAT worksheets to establish 
parameters for operators to input to FLOGEN when generating an automated 
airlift flow. 

(d) Monitoring and analyzing the automated airlift schedule to determine airlift 
flow constraints, recommending changes to improve the flow and, with the 
concurrence of the Special CAT Operations representative, implementing 


required changes. 


(e) Preparing and coordinating MAC mission directives for CATD release. 
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(f) Chairing intercell discussions to ensure unified actions to support the 
operational requirements. 


Three of the above six responsibilities deserve some additional clarification 
and explanation. To begin with, once the бшш Кс are retrieved from the JDS 
data base, they are inputted into MAC’s automated flow generator (FLOGEN). The 
end product from the FLOGEN system is then analyzed for deficiencies 
(deficiencies are inherent within the FLOGEN product, some of these will be 
discussed later). The Requirements and Flow Planning Cell will combine some 
under utilized air missions and cancel some completely due to their limited cargo. 
Once updated the final schedule is then loaded into the JDS data base and 
Previously prioritized TPFDD cargo is manifested against a particular air 
movement. 

The final responsibility of interest is that of manual flow planning (manual 
scheduling of aircraft). This immense and sometimes unmanageable task is 
mandated if there is less than 72 hours to first air movement and no OPLAN 
(TPFDD) exist. Additionally, if any changes are necessary for the next three 
days of schedule, it must be done manually since FLOGEN can only change the 
schedule beyond 72 hours. (This causes a change in the data base of the OPLAN 
or TPFDD. HQ MAC estimates the 72 hours for development of the new data 
base.) If dictated; mission planners must manually match JDS requirements with 
available resources and produce a complete, workable schedule. A ET 
indication of this immense task is illustrated in Figure 3-4. 

To briefly recap, MAC is an active participant in the JCS Crisis Action System 
(CAS). Its main bodv of response is the MAC Crisis Action Team (CAT) which 
provides for the command's focal point in a contingency operation. The MAC CAT 


has a layered organization consisting of the Prime CAT, the Special CAT, and Task 
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Oriented Cells. This approach provides flexibility in assembling only those units 
required for the crisis. As mentioned previously, two of the most important Task 
Oriented Cells are the Classified Automated System (WIN) Cell and the 
Requirements and Flow Planning Cell. While the "WIN" Cell provides the 
connectivity to retrieve the requirements and load the completed schedule, it is 
the Requirements and Flow Planning Cell which performs/executes the 
Headquarters MAC mission. This immense task of air movement scheduling is 
automated to some degree but, inherent deficiencies necessitates at least manual 


analysis if not a complete manual schedule. 


ES 
АЖ! 


IV. POWDER RIVER 1985 HEAT COLLECTION PLAN 





A. PRELIMINARY COLLECTION PLAN 

This chapter will document the changes in the approach taken using HEAT to 
evaluate HG MAC during Powder River 1985. The first encounter with HEAT and 
its application towards PR35 occurred in August 1984, At that time a HEAT 
training session was held and some very preliminary introduction to HG MAC was 
accomplished. 

The next meeting concerning HEAT or HG MAC was in September 1934, 
approximately three weeks later. At this time it was deemed appropriate to visit 
Hà MAC and obtain more information as to how HG MAC is organized during a 
contingency. Prior to this visit, it was appropriate to prepare a tentative list ot 
objectives. This Preliminary Collection Plan (Figure 4-1) was comprised only ofa 
problem statement and a tentative list of HEAT measures. This information was 


based only on a general Knowledge of HQ MAC and air operations. 
B. INITIAL COLLECTION PLAN 


During the HQ MAC visit in late September, 1994, a tour of the Crisis Action 
Center was given. This tour, even though given during a period of construction 
was enlightening on how the MAC CAT operated during a contingency. 
Additionally access was afforded to a draft copy of MAC Regulation 55-25, HG 
MAC CRISIS ACTION TEAM GUIDANCE, MAC’s supplement to JCS’s Powder River 
1985 Manual (S), and a listing of exercise events 1151 (5). All of this information 
proved useful in preparing the first draft of the Powder River 1925 Collection 


Plan (Figure 4-2). 
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HEADGUARTERS MILITARY AIRLIFT COMMAND 
POWDER RIVER 1985 


1.0 Problem Statement 
Pertorm a feasibility analysis for HQ MAC. 
ж Can HEAT be applied for HQ MAC. 
-- Use representative measures from each data category. 


(Personnel Data Category not covered іп original 
measures), 


-- Can Command Standards be quantified. 


2.0 Evolution of HEAT Measures 


Data Category Measure H's 

Enemy Units 2, 3, 4, 104, 105 

Enemy Objectives I2, 13.805 

Enemy Timetable 18, 19?, ΠῚ 

Combat Units 1, 2, SED 235, a ys 
Support Units 1, ὃν Comedy 25,0 76, hO ага 
Units not in Theater ГАЗ ЕЗИ ОО 
Coord/Support Units 1, 23 501053 

Weather 8, 34,108, 118 

Polit/Econ/Soc Guidance 11, 40, e5, ?4 

Critical Shortages 30, 31, 950, ου. τ πη 


Figure 4-1 Preliminarv Collection Plan 
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HEADQUARTERS MILITARY AIRLIFT COMMAND 
POWDER RIVER 1785 COLLECTION PLAN 
3 OCTOBER 1985 


1.0 Problem Statement 
Perform a feasibility analysis for HQ MAC. 
x Бал HEAT be applied for HQ MAC. 


2.0 Background 


Use representative measures from each data category. 


‘Personnel Data Category not covered in original 
measures). 


Can Command Standards be quantified. 
Are there observable HQ cycles, 14 50 observe a limited 
set (2). 


Is HEAT more applicable at a Numbered Air Force or Air 
Division level. 


HEAT can be applied, will it yield useful information. 


Is the Contingency Action Team (CAT) organizational 
structure adequate for the mission. 

Is the concept of Air operations-vs-HG directorates 
appropriate. 

Are CAT procedures adequate for the mission. 

Is training needed, if so: where, what type. 


2.1 Headquarters to be Studied 


* 


MAC CAT 
-- Required representation. 
-- Procedure for calling and the use of the Special LAT 


and the functional units ¢i.e. Connectivity Cell». 


Organization and Responsibility 
-- Prime CAT 


The Prime CAT will focus on airlift concept 
development, coordination with JCS, Services and 
Supported commands, as well as monitoring the 
execution of airlift operations. The Prime CAT will 
be the principal agency through which command guidance 
Is passed for implementation. For close hold, 
conventional operations, the Prime CAT, augmented on a 
selected basis by supporting CAT members, wil! develop 
MAL courses ot action for CINCMAL, JCS, and supported 
CINC approval. 


Figure 4-2 Initial Collection Plan 
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-- Prime CAT Manning and Sourcing 


Position Source Manning 
Director KCATD) MAC/DO Dó 
Executive Officer (CATE) MAC Staff 04/03 
Executive Support NCO {CATN) MAC Staff ΕόΕ5 
Operations САТО) MAC/DO 04 
Operations Plans (CADO MAC/XO DS 
Transportation (CATT) МАС/ТК 06 
Logistics (CATL) MAC/LG 06/05 
-- Special CAT 
The Special CAT encompasses most functional areas 
within the headquarters. Special CAT members serve as the direct 
liaison Between the Prime CAT and their assigned functional areas. It 
should be emphasized that Special CAT members do not work in isolation. 


They are expected to call 
assist them as required. 
-- Special CAT Sourcing 
Position 
Intelligence 
Communications 
Security Police 
Surgeon 
Comptroller 
Liaison Group Army, 
ESCI 


Navy, 
AFRES, 


On members of their functional area staffs to 


source 


IN 


Marine, TAC, SAC, 
and ANG Liaison 


Personnel, as required. 


Public Affairs 
Engineering and Services 
Weather 

Chaplain 

Assistant for Civil Air 
Personnel 

AF OSI 

Administration 

Data Automation 

Special Operations 
Staff Judge Advocate 
Uperations 

Command and Control 
Transportation 
Logistics 

Operations Plans 


РЯ 
ОЕ 
DOW 


AFOQSI MAC Representative 
DA 

AD 

DOX 

JA 

b00 

DOC 

TR 

LG 

κο 


Figure 4-2 Initial Collection Plan continued) 


-- Task-Oriented Support Cell 
The Task-Oriented Support Cells combines expertise 
from across the MAC staff into specific task-oriented 
teams. Cell composition should be reviewed frequently 
by cell team chiefs to ensure the most effective and 
efficient manning is assigned to conduct the detailed 
staff work required.Task-Oriented Cells: 

-- Support Cell Relation to Prime/Special CAT Member 


Support Cell Responsible to 
Requirements and Flow Planning Operations 
Manpower/Personnel Readiness Personnel 

Mission Support and Augmentation Operations Plans 
Station Data Logistics 

Port Management Transportation 
Connectivity Command and Control 
Reports and Briefing Command and Control 
Classified Automated System Command and Control 
Administrative Support CATE 

CRAF Representatives Assistant for Civil Air 


* Functions of Interest 
-- Mobility of aircraft. 
-- Resolution of conflicting demands. 
-- The call-up and employment of the Civil Reserve Air 
Fleet (CRAF). 
-- Deployment of non-unit personnel resources (NPR). 
-- WNon-combatant evacuation order ‘NEQ). 
2.2 Exercise Selection 
* Powder River 1985 
-- H8 MAC, 15 Oct 84 thru 26 Oct 84. 
* Details to be obtained 
-- JCS exercise plan and system description notes. 
-- MAC exercise supplement. 
-- JCS evaluation guide forms. 
* Events of Interest 
See master events list 5) 
2.3 Resources 
* Ubservers 
-- Committed 
NPS---Capt Ronald P Buettner 
DS1---Mr Dan Bucchioni 


Mr Phil Rice 
DCA---Mr John Kirzl 
-- Possible 


NPS---Dr Michael Sovereign 
AFCC--Mr Charles Jacobs ‘poc tor observers) 
JCS---Collection Team members 


Figure 4-2 Initial Collection Plan ‘continued, 
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* Objectives and events to be worked 

-- Stationing of observers. 
Two in the CAT (see floor plan, fig 2) 
One or two in the control group. 

-- Degree of coverage. 
Dates: Exercise Days 1 & 2, 

Exercise Days 8-10. 

Times: single shift (10-12 hrs) 
Events: To Be Determined. 

-- Obtain written data ‘msg traffic etc) 
Arrange with Col Pagani 


3.0 Approach 
3.1 Collection 
* Sources of Data 
-- JCS exercise plan 
-- JCS systems description 
-- HQ MAC exercise plan 
-- HQ MAC supporting plans 
NEO, others 
* Automatic Distribution 
-- Messages and autodin data 
-- Telephone logs 
-- Briefing slides 
-- JCS data collectors worksheets 
3.2 Observers 
* Organization 
-- Two people in the CAT ¿(physical limit) 
-- One or two in the control group 
κ OQObsective-events matrix 
-- Evolution of HEAT Measures (30, down trom 53). 


Data Category Measure H's 

Enemy Units 20223, 4,:104:104 
Combat Units 1, 2, 3200 R 5 74, ΟΥΤΕ 
Support Units 1, 2, З2222723, 725, 102 DE 
Units not in Theater т h 
Polit/Econ/Soc Guidance ll, 40, 65, ?4 


-- Representative coverage of all process steps. 
Direct/coordinate not covered, see tig b-i. 

-- Representative coverage ot ail data cateqories. 
Personnel and Logistics пої covered, see fig b-i. 

-- Recoanize more measures in the monitor and Inform 
areas. 


Figure 4-2 Initial Collection Flan ‘continued? 
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3.3 Command Standards 


* Identify final measures which need command standards. 
* Finalize Proposed Strawman. 
MEASURE # COMMAND STANDARD 
1 a. 100% accuracy on aircraft port location 
and operational status 
b. within two UNITREP categories tor ground 


units 
с. 1004 accuracy for reserve aircraft 
required 
2 Maximum acceptable time late 
а. С" атсега+т—=—-1 hF 
ВН === 24 hr 
с. reserve aircraft----- Га 
ο ο πιο status-———— 24 hr 
4 Desired accuracy location 
а --- 10 miles 
а КЕ 100 miles 
24 Time for implementation of olan 
a. air movement----- 24 hr 
b. logo rasponse----- 24 hr 
с. Qgrd movement----- 24 hr 
24 Intended period of plan, determined for each 
plan 
115 Intended period of status understanding--24 hr 


4.0 Timing 
Names of observers for access 
Measures and Command standards strawman for coordination 


* 
* 


HQ MAC/DOC---Col Pagani 
Hà MAC/DüOX--Capt Wilkinson 


Reseruations---accomplished by individuals. 
Courier orders 
Advance party preparations 


* Procedures for access 
* Gather required documents and plans 
* Set up work area 
* Obtain classitied storage area 
* Set up automatic distribution 
* Coordinate with JCS data collectors 
Su Problem Areas 
Resolve potential conflict ot CRAF representation----- where? 


Potential overcrowding of CAT workarea. Are all] members needed? 


Exgurecd-2? Initial Collection Plan (continued) 
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C. FIRST SUPPLEMENTAL COLLECTION PLAN 


This initial plan was deemed sufficient when the HEAT evaluation started in 
mid-October. (This was not to be the main evaluation effort. This was an 
advance party sent to verify clearances and administrative and logistical support. 
Their second objective was to check the feasibility of the collection plan). 
However, during this brief two-day visit, the advance party identified some 
shortfalls with the existing collection plan. The observations of the advance 
party led to the following amendments to the Collection Plan (Figure 4-3). In 
addition, the advance party developed data collection aides based on the displays 


used by the Crisis Action Center (Figures 4-4 to 4-7). 


D. SECOND SUPPLEMENTAL COLLECTION PLAN 


This first supplemented plan was based on the information gathered by the 
advance team. It was the first time that any direct observation of the HG MAC 
CAT was afforded. This first-hand experience of the CAT operations, as limited 
as it was, provided the additional information needed for a workable collection 
plan, or so it appeared. However, during the main collection effort, serious 
deficiencies in collection plan were found. The most serious deficiency was in the 
actual concept of the MAC CAT organization and function. 

Up to this time, the Prime CAT was considered to be the focal point of ali 
action for this exercise. This was not true in this particular instance. With the 
inability to obtain actual ground truth information (another serious deficiency in 
the collection plan)? due to the nature of this Command Post Exercise (CPX), the 
actual center of activity was with the Requirements and Flow Planning Cell. (It 


is my opinion that this would be the center of most activity in any exercise or 


бб 


HEADGUARTERS MILITARY AIRLIFT COMMAND 
POWDER RIVER 1935 COLLECTION PLAN 
(SUPPLEMENTED 14 OCT 85) 


2.0 Background 


2.1 Headquarters to be Studied 


* 


МАС САТ 

-- Required representation, 

-- Procedure for calling and the use oi the Special CAT 
and the functional units &i.e. Connectivity Cell3. 

Ürganizational Structure 

Same as initial collection plan 

Functions ot Interest 


== Moom of aircraft. 

-- Resolution of conflicting demands. 

-- Allocation of Airlift Resources 
1, Determine and analyze movement requirements and 

current airlift capability to meet those 

requirements. ‘monitor/understand) 

Prepare manual flow plan to support requirement. 

(plan) 

3. Prepare worksheets for flogen when generating ап 
automated airlift flow plan. (plan) 

4. Monitor and analyze automated airlitt schedule to 
determine airlift flow constraints and make 
improvements. ‘monitor/understand) 


9. Prepare and coordinate MAL mission directives. 
(direct? 


n 


Figure d-3 First Supplemental Collection Plan 
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3.0 


Approach 


3.1 Collection 

* Sources of Data 
-- JCS exercise plan 
-- JCS systems description 
-- HQ MAC exercise plan 
-- HQ MAC supporting plans 

NEG, others 

* Automatic Distribution 
-- Messages and autodin data 
-- Telephone logs 
-- Briefing slides 
-- JCS data collectors worksheets 


3.2 Observers 
* Organization 
-- Two people in the CAT (physical limit) 
-- One or two in the control group 
* Objective-events matrix 
-- Evolution of HEAT Measures (20 from 30 trom 53), 


Data Category Measure #5 | 

Combat Units ο. ἐν 3.029. 20g]. 015 

Individual Ор Plans 48. 50, ον ov 075-75, Sl, dem 
I. Za 


Figure 4-3 First Supplemental Collection Plan ‘continued? 
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MISSION SUMMARY AS ο... A 
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тш заа = =s 
ame | | | | ® 
OPERATED 
REMAINING 
MISSION SUMMARY AS OF 2 


sucus mu. 


SCHEDULED 


weno | | 1 


REMAINING | 


RESPONSIBLE AGENCY 


SOURCE DOCUMENT 


Figure 4-4 Data Collection Aide 1 
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FORCE STATUS AS OF Z 


UNIT OR AIRCRAFT CREWS 


LOCATION | OR | NORM |NORS | OR HRS | | | | 


RESPONSIBLE AGENCY 


SOURCE DOCUMENT 





Figure 4-5 Data Collection Aide 2 
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AIRFIELD DATA AS OF 


N 


LOCATION 


— 


Med 8 


RESPONSIBLE AGENCY 


SOURCE DOCUMENT 
Figure 4-6 Data Collection Aide 3 
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RESPONSIBLE AGENCY 


SOURCE DOCUMENT 


Data Collection Aide 4 


Figure 4-7 


contingency involving airlift requirements). As such, for all of the collection 
effort, the data gatherers were concentrating in the wrong location. Realizing 
the problem, the data gathers tried to adapt the HEAT process (one relying on 
ground truth as a basis) to this particular exercise and in general to any exercise 
where ground truth would not be available or obtainable. The results of this 
effort are documented in the Second Supplemental Collection Plan (Figure 4-2) and 


will be elaborated further in the next chapter. 


E. POST COLLECTION PLAN 


With the realization that most of the data would not support a detailed HEAT 
evaluation (due to the lack of ground truth information), a search was begun to 
see what information could be extracted from the data. After a complete sifting 
of the data, the only useful and supported analysis was the measure cf 
effectiveness for the intended period of the plan. However, while this is one of 
the major measures in the HEAT process, it did not provide insight into the 
effectiveness of this organization since the one occurrence of plan conflict did 
not occur during the evaluation process. (The data gatherers were not present 
during this period because it was deemed a period of low interest by the MAC 
representative). Thus, a HEAT analysis was not possible with the data captured. 
However, the attempt to formalize a means to apply HEAT when no actual ground 
truth information is available resulted in useful information and a some what 


successful evaluation. 


Us 


HEADQUARTERS MILITARY AIRLIFT COMMAND 
POWDER RIVER 1925 
COLLECTION PLAN 
(SUPPLEMENTED 25 OCT 35) 


2.0 Backaround 


2.1 Headquarters to be Studied 


* 


MAC CAT 

-- Required representation. 

-- Procedure for calling and the use of the Special CAT 
and the functional units ¢i1.e. Connectivity Cell). 

Organizational Structure 

Same as the initial collection plan. 

Functions of Primary Interest 

~-=Mebt lity Of -atirarestt. 

-- Resolution of conflicting demands. 

-- Allocation of Airlift Resources 
1. Determine and analyze movement requirements and 

current airlift capability to meet those 
requirements. ‘monitor/understand> 

. Prepare manual flow plan to support crisis or 

contingency requirements. (plan) 

3. Prepare worksheets for FLOGEN ‘an automated 
airlift flow plan. (plan) 

4. Monitor, analyze and recommend improvements to the 
automated аг t schedule, 
(moni tor/understand/plan? 

9. Prepare and coordinate MAC mission directives. 

(direct) 
NOTE: All of these functions are performed by one 
portion of the MAC contingency staff, the 
Requirements and Flow Planning Cell. It 13 
foreseeable that most of the data categories and 
HEAT measures are appropriate for this cell. If 
the scope of the evaluation was narrowed to the 
monitoring of assets, the building of the plan, 
and directing the execution of the plan: all ot 
this can and should be evaluated from within this 
cell. 


Figure 4-8 Second Supplemental Collection Plan 
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3.0 Approach 
3.1 Collection 
* Sources of Data 
-- JCS exercise plan 
-- JCS systems description 
-- HQ MAC exercise plan 
-- HG MAC supporting plans 
NEG, others 
* Automatic Distribution 
-- Messages and autodin data 
-- Telephone logs 
-- Briefing slides 
-- JCS data collectors worksheets 
3.2 Observers 
* Organization 
-- Two people in the CAT (physical limit) 
-- One or two in the control group 
x Objective-events matrix 


-- Evolution of HEAT Measures (28 vice 20 or 33) 
Data Category Measure #5 
Personne] 2Û 
Enemy Objectives 15201011) 
Combat Units νε, 29. QU E 
Support Units I σι σόι 191 
Theater Op Plans Во σι. 122 
Individual Op Plans τυ. οι οι οι Nu 
Critical Shortaqes 51:1122 


Fiqure 4-8 -Second Supplemental Collection Plan ‘continued) 


ο. 


V. RESULTS AND RECOMMENDATIONS 


A. HEAT RESULTS 

With all of the changes and difficulties mentioned in the last chapter, where 
does this leave the HEAT analysis of Powder River 1985? Since the analysis was 
to be performed on the MAC CAT organization as a whole and that the initial 
collection plan as modified by the advance party (fist suppllemental plan) was 
deemed sufficient (at the time), the analysis efforts were based on that 
collection plan. While the second supplemental collection plan would be better tor 
a similar analysis of the MAC CAT now or in the future, it is inappropriate for 
what was observed and collected during Powder. River 1985. 

Recall, under the First supplemental Collection Plan, there were a total of 
twenty HEAT measures to be applied. These twenty measures along with the 


required data sheets and score sheets are presented in Table 5-1. 


TABLE 5-1 POWDER RIVER 85 HEAT MEASURES 


MEASURE #’s DATA SHEET SCORE SHEET 
i, 2, 3, 94, 99 F 0, F 
24, 25, 48, 50, 52, 113 U и, А, В 
69, 123 P P, T 
75-78, 81, 86, 91 D α, H, D, K 


With these measures selected, the data was collected and compiled onto the 
data sheets. There was little difficulty in assembling perceived or reported data 
for the data sheets, however, with the absence ot a ground truth, that category of 
data was left blank (refer to Data Sheets Source Type P-perceived, R-reported, 
and T-qround truth). As such, for Data Sheet F (Figure 5-1) all columns could be 


filled for perceived and reported states but none for ground truth. For Data 
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Sheet U (Figure 5-2) only column 1-current situation, column S-end of forecast 
period, and column ó-number of planners could be filled out for the perceived and 
reported states. The remainder of Data Sheet U could not be filled out because 
there was no change in the situations that were observed (the one Known change 
in situation the data gatherers were not present due to a period of supposedly 
slow activity). The same comments apply to Data Sheet P (Figure 5-3). Again, 
there was no change in situation observed and no ground truth to record. For 
Data Sheet D (Figure 5-4) little information could be entered. All directives 
issued were for new plans, existing plans or decisions were not changed (for the 
data observed). This resulted in only the time of issue and intended period of the 
plan along with the information on did the directive contradict the commanders 
decision being recorded. 

From these data sheets an attempt was made in scoring the available data. 
Table 5-2 illustrates the score sheets corresponding to the data sheets used and 


their reliance on ground truth to produce a score. 


TABLE 5-2 POWDER RIVER 85 SCORE SHEETS 


Requiring Not Requirina 
Data Sheet Ground Truth Ground Truth 
F в Е 
U U, R a 
P P, T 
D H Q, D 


With the absence of ground truth only three of the ten score sheets could be 
completed in some detail. Score Sheet A (Figure 5-5) attempts to score the 
planning process relying on a number of alternative actions for each contingency 
actual taken. Since MAC's plans deal with the generation of an airlift schedule, 


alternative schedules are not considered only one airlift schedule is prepared. 
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As such, the raw and normalized score is always zero when no alternatives are 
considered. Score Sheet Q (Figure 5-6) attempts to measure the quality of the 
plan instead of the process. For the periods of data collection (recall, the one 
Known instance of change was not collected), there was no change in situation and 
allplans lasted their intended period. This results in a raw score always equal 
to one. Score Sheet D (Figure 9-7) measures the accuracy of the directive in 
relation to the decision. In all cases observed there was no directive that 
contradicted the commanders decision. This will almost alwavs be the case when 
only one plan is generated and the decision is to implement that plan. 

Thus, for Powder River 1985, HG MAC prepared quality plans (for the plans 
observed) that reflected the decision of the commander. However, these plans 
were based on only the one alternative and were static in nature. If a change in 
the perceived situation would occur it is doubtful that the plan in effect could 


accommodate the change (as was the case in the one known change not recorded). 


B. PROBLEMS ENCOUNTERED 


There were two major problems encountered in the analysis of HG MAC during 
Powder River 25. The first was the absence of ground truth, the second was a 
misperception of where the center of planning activity was located. Both of 
these problems stem from one cause, not enough time and effort given to planning 
the collection effort. 

For HEAT to work successfully, a full and thorough understanding of the 
organization and the exercise is required. This was not obtained in this instance 
until well into the collection effort (in fact the collection effort was almost 
over), The failure in understanding the exercise and how it was conducted led to 


the inability to capture ground truth. Knowing that an actual ground truth ‘that 
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normally available during a field exercise where combat units are actually 
positioned) was not available, procedures or corrective actions could have been 
taken or developed to enable a successful collection effort. This indeed is what 
happened when the Second Supplemental Collection Plan was conceived. The 
misunderstanding of the center of planning activity is secondary in comparison. 
While the main collection effort would not have been focused on the planning 
activity, good reliable data that could be based or compared could be obtained. 
The planning process could not have been evaluated in this posture but most 
other measures could. If both misconceptions could have been avoided a 
successful analysis may have resulted. 

However, to completely overcome the misconceptions, a more thorough 
understanding was required. This takes time. In this respect HEAT is a very 
front loaded, time intensive project. To achieve this detail of understanding, the 
data gatherers must have almost first-hand experience about the type of exercise 
and the organization. Without the time taken to gain this first-hand experience, 
the problem of not knowing where to best place the data gatherers will surface 


again and again. 


C. PROPOSED HEAT APPLICATION FOR FUTURE CPX's 


One of the problems encountered, was the absence of a ground truth. This, in 
part, is based on the notion of ground truth tied to the actual movement of forces 
(either actual movement as in a Field Training Exercise, FTX, or simulated as in 
computer simulation or better controlled CPX). This tying of ground truth to the 
movement/location of force is a hindrance for this type of CPX. Assumptions can 


be made to obtain a quasi ground truth when no forces are involved in the 


exercise. Assumptions of this type were the basis of the Second Supplemental 
Collection Plan. 

In the case of Powder River $5, the Requirement and Flow Planning Cell was 
taken as the center of activity or planning process. An artificial boundary was 
placed around this cell for the purpose of data gathering. All data within the 
Requirements and Flow Planning cell was considered perceived data while data 
outside the cell was considered ground truth. This enabled the comparison of 
data required with HEAT. The comparison in this instance was how well the 
Requirements and Flow Planning Cell perceived the data that the remaining 
sections of the MAC CAT provided. Thus, all the data requirements of perceived; 
reported, and ground truth could be captured. 

The question remains, do the results obtained apply to the organization as a 
whole or just to the one part. Given that the artificial boundary encases the main 
planning function of the organization, then the results can be interpreted as 
applying to the entire organization. This will only work if the essence of the 
planning activity is enclosed in the boundary. If decisions for the entire 
organization is made outside the imposed boundary then there are other factors 
to consider before the results can be postulated to whole. If on the other hand, 
allorganizational decision are made inside the boundary then the essence of the 
organization has been captured (for this purpose) and the results can apply. (This 
is a new concept in applying HEAT and therefore should be approved or recognized 


by HEAT theorist before an application is tried.) 


D. POTENTIAL AREAS OF FURTHER STUDY 


1. Computerized Data Entry 


With the use of micro computers the sometimes immence task of recording 
information may be made easier. At times the observer is overwhelmed with data 
that needs to be recorded. The use of a menu driven or menu aided computer 
device these periods may be less frequent. This has been attempted at the Naval 
Postgraduate School first, with Dr. J. Lawson in the spring of 1985 and second, 
during the DCA/DSI War Game Exercise in December, 1935. (Both times Radio 
Shack M100's were used.) More analysis is needed in the area to confirm that the 
computer aided input is a benefit or not. 

2. Computerized Data Scoring and Presentation 

This area has seen little interest in the past by either DCA or DSI. 
However, some preliminary work was attempted in the spring of 1935. At that 
time, an attempt was made to use a relational data base for the MacIntosh (Helix, 
by Odessta) to store the collected data from the HEAT Instruction Manual and 
make queries upon the data similar to the HEAT Score Sheets. The ideal was gooc 
and the tools did exist (dBase III for example) however, the data base selected 
(Helix) was not fully capable at the time of the undertaking. (Since then, Odessta 
has improved upon Heli« with two revision released to make it more capable) A 
renewed attempt in this area using either Helix or another relational data base 
would prove to be an interesting study. 

3. Testing of the Proposed HEAT Application for CPX's 
This proposed application contained in this thesis requires further 


investigation and testing. Assistance in this endeavor may have to come or 


originate from either DSI or DCA. If such a study was attempted this author 
wOuld appreciate any Knowledge gain from the attempt. 
4. Reevaluation of HG MAC 

Since this thesis did not come to any conclusive results for HG. MAC, a HEAT 
analysis should still be performed. The Crisis Action Team structure at MAC has 
had time to develop and correct some of the inherent problems with a new 
organization. (Powder River 85 was the first time that this version of the MAC 
CAT was ever convened for an exercise.) Also, this study and similar HEAT 
studies would aide the evaluation team in preparing for the analysis. Remember, 
the more time spent in the planning for the evaluation, understanding the 
organization, and Knowing the exercise limitations, the better the chance of a 


successful HEAT analysis. 
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